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(54) I Handwritten keyboardless-entr/ computer system 



(571 A keyboardless-entry computer system includes a transparent input screen (18) that generates 
positional information when contacted by a stylus (16), and a <iis£!aiscreen_j20) mounted below the.inRUL_ 

^hat is displayed can be se eif Felow t he input screen (iBlTThe system 
includes a computer (14) programmed to compile the positibn"inrifformatio^ to calculate 

Stroke characteristics, and then compare the Stroke characteristics with those stored in a database in 
order to recognise the symbol drawn by the stylus (16). The system may be used to edit text or complete 
standard forms, e.g. with medical data. 




The dravvtng(sl originally filed was/were informal and the print here reproduced is taken from a later filed formal copy. 
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I - Fpinted Circuit Boara 

The Board's siw, cost, poHer consuHytion, anA . 
relialiility are crltioal to the sucess or our product. 

The Iroard husI (II In our m^mt «hlch IIhUs Us 
liHenslons to soHelliiiig hie 18" )l5^ op aljoii 59 smn 
inches. Rooft mist le -available fop dealep instaliable 
options such as additional Hettorg and Bodea - possibilj as 
piggy back boa^d5,y^^ 

Poner coRSUHption.Kust be Ioh enough so that the 
batlries in the product can provide (or akut 8 hours of 
operation and al»out 2 Heeks of data retention, These we , 
exolusivei iiC. 8 hours of operaltoDjoUoHed bg I Heeks of 
data retcntioD is required, Hith this kind of poHer 
consuHpticn heat sltould not be a ppobleH. 

Civen our cost. and pohbp poquircHents Me eKPect that kb 
Hill be using CHOS lechnolpgsi llipougi.out. He^also eweot 
to use Supface Hounted Tecluiologg(SnT). Slfl alloKs a denser 
packing, Hore shock resistence, and lower nanufao tor ing^^ 
owli. altkugh Initial cojIi Bay be si yMIy hiSfheP.. The 
final decision oo SKI Hill depend upon ifie avallabllitg of 
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SPECIFICATION. 

Handwritten keyboardless-entiy computer system 

5 The present Invention relates generally to a keyboardless input system to a computer, and when 
combined with a central processing unit, to a keyboardless-entry computer system. More parti- 
cularly, the present invention relates to an information storage, manipulation and transfer device 
on which text data, computer commands and functions can be entered by writing alphanumeric 
or any other characters and symbols by hand with a penlike stylus on an Input/Output (i/0) 
10 screen. In a preferred embodiment the I/O screen includes a transparent touch screen incorpor- 
ated over a substantially flat output display. The present invention in its prefen-ed embodiment i$ 
a self-contained computer system but can also function as a peripheral to a host computer. 

Large amounts of information and sophisticated applications software are now available on 
conventional keyboard computers. The utility of this information and of application software 
15 could be greatly increased if text and data could be entered and applications software manipu- 
lated by wnting In a normal fashion directly on a flat display. Thus, there is a need to allow the 
utility of computer technology to be extended for use by non-keyboard oriented individuals 
There is also a need for a portable computer system that is lightweight, reliable, accurate 
inexpensive and permits use while standing or walking. One way to reduce expense and size and 
20 increase utility is to employ a keyboardless entry system, such as a touch screen. However this 
type of input device does not easily allow accurate detailed input within a real time framework 
with high resolution in a manner which is familiar and natural to the user. 

Many positioning technologies can be used to meet the requirements of the position sensing 
input technology. Essentially these requirements include accuracy, resolution and speed. The 
25 technologies include: mechanical, electrostatic, electromagnetic, acoustic, optical, and inertial The 
desire in this system is to have its use as similar as possible to writing with pen or pencil on 
paper. One problem is proximity— a pen on paper only leaves a trail when actually in contact 
Many of these technologies require an additional "pen down" sensor which is awkward to use 
in many commercial pens. Another problem is writing angle— a pen leaves the same trail 
30 independent of writing angle. Many of these technologies have the position detector displaced 
frorn the pen tip so pen angle causes en^oneous displacements. Beyond these general problems 
.each technology has numerous advantages and disadvantages in (1) the pen: size, weight, shape 
and whether it needs to be powered and/or wired, and (2) the writing surface: transparency 
J smoothness, "feel", and whether or not physical contact is needed (as opposed to pressure 
3b(,( transmitted through overlaying sheets of paper). 

A number of self-contained devices for viewing and processing large amounts of information 
are known. Most employ optical, magnetic or solid-state electronic storage means to store data 
Illustrative of this body of art is U.S. Patent 4,159.417 to Rubincam which discloses a portable' 
electronic book configured to provide selective page, by page call-up of large amounts of digital 
40 data and displays it on a flat, solid-state screen. The preferred embodiment in the Rubincam 
patent uses an insertable holographic card, which may contain several hundred pages of text in 
digital form, as the mam storage means. Rubincam's device, however, does not allow new 
information or text to be entered or manipulated. 
In U.S. Patent 4,016,542 to Azure an electronic data collection system is disclosed which 
45 employs a solid state Random Access Memory (RAM) for its primary memory. This patent 
which discloses a conventional keyboard for data entry, is directed to a hand-held portable' dgta 
storage and transmission system, as well as an LED display and various Input/Output (I/O) 
connectors. ' k ^ w 

tzn A 3,487,731 to Frank discloses a means of converting handwriting into character 

50 data through the use of a computer system. The disclosed invention is based on matrix pattern 
matching and does not employ any coincident display technology. 

U.S. Patent No. 4.491,960 to Brown shows a handwritten symbol recognition system in 
which an array of image Points, in the form of a raster line sampling, is converted into segment- 
oriented lists which are filtered and compressed to obtain topologic features which are then 
bb analyzed with a logic tree decision mechanism. 

US. Patent No 4,262,281 to Buckle era/, discloses a handwriting recognition device The 
techno^^^ ^ ^"^^^ computer and does not employ 6oincident display 

U.S. Patent No, 4,475,239 to Van Raamsdonk discloses a text editing apparatus The '239 
60 patent cells for the use of paper as a medium for the entering of editing functions and requires a 
conventional keyboard for the inputting of text. 

U.S. Patent 4,521,909 to Wang shows a dual level pattern recognition system. The system is 
designed for use with an optical instrument. 
U.S. Patent 4.520,357 to Castlebeny et a/, discloses an electrascopic information display and 
65 entry system with writing stylus. The disclosed embodiment does not claim to have the speed 
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or accuracy to enable handwritten character recognitfon. 

Additional prior art which discloses portable electronic devices that'provide large amounts of 
various types of stored information include U.S. Patents 4,218,760 to Levy; 4,4115,486 to 
Laine; and 3,932,859 to Kriakides et aL The Levy and Kriakides et aL patents pertain to 
5 electronic dictionaries, while the Laine patent discloses a programmable television reminder 5 
system. None of these devices disclose the use Of a handwritten input. 

In U.S. Patents 4,071,691, 4,129,747, 4,198,539, 4,293,734, 4,302,01 1, 4,353,552, 
4,371,746 and 4,430,917 to William Pepper, Jr. various methods or machine-human Interfaces 
using finger touch are disclosed. The preferred embodiments in each of these inventions lack 
10 sufficient speed and resolution to allow handwritten character recognition with a stylus and are 10 
designed for other purposes. U.S. Patent 4,318,096 to Pepper teaches the use of a conductive 
stylus. The '096 patent pertains to graphic design and allows line wfdth and line intensity to 
vary by applying pressure on the stylus with the results displayed on a conventional CRT screen. • 
U.S. Patent 3,699,439 to Turner. and U.S. Patent 4,055,726 to Turner et al discloses two 
15 methods for electronic position sensing through, the use of a probe. 15 
The invention in its various aspects is defined in the appended claims to which reference 
should now be made. 

A preferred embodiment of the invention which is described in more detail below with 
reference to the drawings comprises a unique keyboardless computer system which has the 
20 ability to recognise and display Handwritten Symbols and Cause the computer to display Font 20 
Symbols and, if desired, to execute editing functions pursuant to Editing Symbols, quickly, easily 
and at reasonable cost. 

This preferred embodiment includes a computer housing with a flat display panel on which a 
user may "write" with a stylus, and has a capability to recognise Handwritten Symbols written 

25 on the panel with the Stylus and convert them to displiayed Font Symbols, and/or to execute 25 
Editing Functions with Editing Symbols, all with a minimum of technical complexity for the user. 
Once the keyboardless, portable computer is loaded with the desired information and applica- 
tions software. Information and software can be used and responded to without requiring skills 
or knowledge related to state-of-the-art computers or other data source. The ease-of-use of the 

30 input technology of the apparatus enhances the utility of the- computer for keyboard oriented 30 
individ^jals. Its portability also allows it to be used in applications and settings in which portable 
keyboard computers are awkward,' difficult or impossible to use; For example, a multiplicity of 
blank, fully or partly completed forms may be stored in the portable computer memory. In a 
hospital, "sheets'' of patient data can be stored in the memory of the portable computer^ called 

35 up by a nurse as the nurse makes rounds and relevant data, such as blood pressure, tempera- 35 
ture, etc., can then be entered manually with a stylus. These corrected or expanded forms can 
then be down-loaded into a central computer memory. 

The requirements of the position sensing Input technology are accuracy (Point to Point), 
resolution (absolute position) and speed (Points per unit time) to adequately define the written 

40 Stroke for recognition analysis. For the recognition apparatus and methods presently used, as 40 
described below, the present minimum requirements are: accuracy of 0.125mm (0.005 inch), 
resolution of 0.375mm (0.015 inch) and speed of 150 Points per second. This accuracy allows 
a 6mm (1/4") high writing line with over 10 raw input Points along a Stroke of a small letter. 
The resolution provides positioning of the symbol to within two pixels on a present display of 

45 640 pixels to 225mm (9 inches). The speed permits about 50 raw input Points for a rapidly 45 
written single letter (1/3 second). 

One embodiment of the present invention comprises a transparent input screen. As the user 
writes alphanumeric or other characters or symbols on the input screen, the character is repre- 
sented as a stream of Points emulating written input with pen on paper. Once the discrete 

50 alphanumeric and other characters or symbols are complete, they are translated into computer 50 
text or computer commands that can be displayed on a display screen at a location that is 
preferably beneath the area on the input screen where they were entered. The embodiment also 
comprises a pattern recognition algorithm which allows the translation of any written character 
or symbol, such as ideographs and scientific symbols, into computer text. 

5|. In a particular, presently preferred embodiment, a keyboardless computer is configured as a 55 

J manipulation and display device comprising a transparent touch screen and associated electronics 
'[ placed over an 80 column by 25 line or larger display screen; a stylus for entry of data; a 
\ microprocessor and storage means; artificial intelligence/pattern recognition software and editing 
software; and a battery power system; and other I/O means; 

60 As used herein, "Handwritten Symbols" are any symbols capable of being handwritten and 60 
having communicative effect. By way of example, and. not limitation, numbers, letters, "Kanji" 
(Japanese ideograms) or other language symbols, editing symbols and engineering, scientific, 
architectural and mathematical symbols are Handwritten Symbols. Other examples of Handwritten 
Symbols are free-hand drawings or signatures or any other such written infomiation uniquely 

65 configured by a particular writer. Handwritten Symbols may also include Editing Symbols (defined 65 
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below). 

As used herein, "Font Symbols" are computer-generated symbols which are displayed in a 
predetermined font format. By way of example and not limitation, alphanumeric symbols may be 
Font Symbols and displayed in numerous font formats. Japanese or Chinese "ideograms" may 
5 also be Font Symbols, as may be engineering, scientific, mathematical, architectural or other 5 
such characters. Other examples of Font Symbols include any form which can be stored and 
displayed by a computer, e.g., a drawing of a car or a house. 

As used herein, an "Editing Symbol" is a symbol (such as a caret, horizontal line, short 
vertical line, long vertical line, etc.) which is Intended, when recognized, to cause the computer 
10 to execute a particular Editing Function (defined below), such as insert test (caret), delete text 10 
(horizontal line) delete a letter (short verticai line) or move a margin (long vertical line), to list a 
few representative examples. 

"Editing Function" means any computer-generated text editing opiaratlon, such as by way of 
example and not limitation. Insert text, delete text, move text and substitute text. Some prirpary 
15 Editing Functions are listed towards the end of the description below. 15 

The preferred embodiment of a keyboardless entry computer system will now be described 
that includes a transparent input screen that generates positional information when contacted by 
a styles, and a display screen mounted physically below the input screen such that a character 
that is displayed, can be seen below the input screen. The system includes a computer pro- 
,20 grammed to compile the positional information Into Strokes, to calculate Stroke characteristics, 20 
and then compare the Stoke characteristics with those stored in a database in order to recog- 
nise the symbol drawn by the stylus. Key features of the system are: (A) transparent position 
sensing subsystem; (B) underlying display on which to mimic drawing of sensed positions and to 
show characters or symbols; (C| means to convert sensed positions first into plotted Points and 
25 then into recognised characters or symbols; and (D) means to "legrn" to associate sensed Input 25 
positions with a character or symbol. The apparatus can be housed in a portable unit having 
dimensions up to about 400mm by 400mm by 100mm (16" x 16"x4") and a weight of up to 
about 7 kilograms (15 pounds), with a self-contained power supply. 

30 Brief Description of the Drawings 30 
The preferred embodiment of the invention will be described in more detail by way of example 
with reference to the drawings, in which: 

' Figure 7 is a schematic system block diagram of an embodiment of the present invention; 
Figure 2 is a perspective view of the housing containing the operating element of the system; 
35 1 Figure 2A is an enlarged portion of Fig. 2, with parts removed to show the positional 35 
relationship between the touch input screen and the display screen. 

Figure 3 is a schematic diagrammatic view of the Input screen, stylus and associated electron- 
ics; 

Figure 4 is an overall schematic system block diagram of the apparatus of a keyboardless 
40 entry computer system according to the present invention; 40 

Figure 5 is a schematic block diagram depicting the movement of data within the system 
when modified by handwritten characters and commands; 

Figure 6 is an overall system block diagram depicting the hierarchy of software used to 
operate the system; 

45 Figure 7 is a generalized block diagram of the character and pattern recognition algorithm. 45 
Figures 8 A and 6B together are a detailed block diagram of the pattern recognition algorithm. 
Figure 5 is a schematic block diagram of the Stroke characterization subroutine. 
Figure 10 is a top plan view of a screen illustrating the "initializing" of the database for 
Handwritten Symbols. 

50 Figures 1 1A through 111 are a series of top plan views of screens depicting the operation of a 50 
text editing system. 

Figures 12A through 12G are a series of top plan views of screens depicting the operation of 
a data entry system. 
Figure 13 Is a generalized block diagram of the Linus Editor. 
55 55 
Detailed Description of the Preferred Embodiments: 

With reference now to the figures, wherein like numerals indicate like elements throughout the 
several views, and in particular with reference to Fig, 1 , an overall block diagram of a portable 
handwritten, keyboardless entry computer system 10 is depicted. The complete cpmputer sys- 
60 tem is encased in a housing 12,. indicated graphically by the dashed line, and includes a 60 
conventional general purpose digital microcomputer 14, described in greater detail hereinbelow. 
Input information is provided to microcomputer 14 by stylus 16 "writing" on writing or input 
screen 18. Stylus 16 (Fig. 2) is connected to the computer of system 10 with wire 17 (Fig. 2). 
As stylus 16 "writes" on input screen 18, a plurality of locating signals representative of a 
65 plurality of corresponding positional coordinates are transmitted to microcomputer 14. Microcom- 65 
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puter 14 has been programmed in accordance with a computer program described hereinbelow, 
to recognize the stream of locating signals and to store these signals in a computer memory. 
The programmed microcomputer 14 also provides a corresponding plurality of display signals to 
a display screen 20. Both input screen 18 and display screen 20 are described in greater detail 
5 hereinbelow. ^ 
Referring now to Fig. 2, there is shown a perspective view of keyboardless computer system 
.10 embodying the features of the present invention. Keyboardless computer system 10 is 
contained in housing 12, which is a rectangular enclosed casing having a sloped top surface 22 
with a multi-line, solid state display area 24. Input screen 18 is depicted in Fig. 2A as being 
10 positioned over display screen 20. In this e;(ample, display screen 20 displays a plurality of 10 
horizontal lines 25 with the following indicia: 



Name 
Address 



.15 



15 



30 



Handwritten entries, are made above each line 25. The distance or space between two lines 25, 
denoted 26, is used by the system to. normalize all distances, and lines 25 themselves serve as 
a reference axis or base line. * ori 

20 Below display area 24 on top surface 22 is a key input section 26 comprised of a plurality of M 
"Softkeys" 28. Softkeys 28 can be programmed by the operator for any purpose, such as to 
enter computer commands. Exemplary commands for Softkeys ZB are "store," "recall," and 
"delete". In addition, Softkeys 28. can be used. to switch between different programs or 
between modes (e.g. data entry mode and edit mode). However, Softkeys 28 are optional and 

25 are used to supplement the input obtained by handwriting the entries. Stylus 16, used for 25 
writing input data and commands in display area 24, .also is used to activate the selected 
Softkey 28. An ON-OFF switch 30 is. positioned on the side of housing 12 adjacent to Softkeys 
28. A data output or peripheral connector 31 is located on the upper right side of housing 12. 
f Input screen 18 can be a conventional resistive type touch screen in which a voltage is 

3dV applied to the screen edges and a stylus detects the voltage at the touched location. The writing 
surface is a transparent material, typically glass, coated with a thin, uniform, conductive layer 
(presently, vacuum deposited indium tin oxide). Vertical bus bars or conducting strips (not 
V shown) are used along the two sides to apply the reference voltage to determine the "X" 
coordinates of the stylus position and horizontal bus bars or conducting strips (not shown) are 

35 used along the bottom and top to apply the reference voltage to determine the "Y" coordinates 35 
of the stylus position. In this embodiment, stylus 16 Is merely an electric probe that, when 
physically in contact with the conductive layer; vJetects the local voltage at the Point of contact, 
which will vary with the distance from the conducting strips or bus bars. With the origin at the 
Point of voltage application, the X, Y coordinates are inversely proportional to the impressed 

40 voltage. Stylus 16 must make good contact to minimize adding resistance that would lower the 40 
voltage detected, and thus add an erroneous distance increment. In a presently preferred em- 
bodiment, a soft graphite tip is used. The voltage is conducted from the pen through a wire, 
such as wire 17 in Fig. 2, to an analog to digital converter for use in the compulations 
described below. The stylus may be a charged "pen" as described herein, a light pen as is well 

45 known in the art, or any other hand-held device which can outline Handwritten Symbols on a 45 
screen. 

An example of a conventional electrostatic screen is disclosed in the aforementioned 
4,318,096 Pepper patent. This resistive type screen has the advantage that the interference 
caused by the user's hand touching the screen is minimized. 

50 Both horizontal and vertical position sensing is provided by alternately switching the voltage 50 
impressed on a conductive layer between the pairs of horizontal and vertical bus bars by an 
interface and multiplexer controlled by a microcomputer or microcontroller. In one commercially 
available input or touch screen, the bus bars are broken into a series of short strips with diodes 
to prevent the horizontal strips from shorting out vertical strips and vice versa. This technique is 

55 used in a commercially available touch screen from Touch Technologies of Annapolis, MD. and. 55 
Elographtcs of Oak Ridge, Tenn. 

Referring now to Fig. 3, an alternate embodiment of a low power position sensing novel input 
screen 33 is described in greater detail. Input screen 33 is also for determining an X,Y position 
on an electrically resistive plate 34. A stylus 35 containing a voltage source, such as battery 36 

60 or a voltage transmitted to stylus 35 from an. external source such as the system power supply, 
is used to touch screen 34 and apply a voltage at the touched position. When the touched 
position is charged by stylus 35 with a positive voltage with respect to a plurality of piate 
measurement Points 37, the voltages at these Points will vary with the distance to the pen 
position, such as position Xi, Y,, indicated at 38. These voltages are sequentially measured in 

65 the X and Y directions by using conventional means, such as disclosed in the aforementioned 65 
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prior art patents. In Fig. 3 these means are a conventional interface/multiplexer 42. A conven- 
tional Analog-to-Digital converter 43 converts the detected voltages into a digital signal. A 
nnlcrocontroller 44 receives the digital signal, performs standard checks to insure the signal's 
numerical value is "valid" (e.g. is within the possible range of voltages}, and then converts the 
5 voltages to X and Y distances in the manner described herein. IVIicrocontroller 44 is conven- 5 
tional, but could be replaced by a system computer. Microcontroller 44 provides a digital signal 
representative of the X and Y distances to measuring Point 38 to an output port 46. Port 46 
can be a conventional RS 232 port. Alternatively, microcontroller 44 could translate Point X^ Y, 
to any other reference Point, such as a Point on base line 25 (Fig. 2). 
10 As long as there is no contact by stylus 35 at position 38 or any other position on plate 34, 10 
no current flows and power consumption is minimal. An incident measurement of the voltage at 
the measurement Points may occur by using ramped voltage at the positioning Point and timing 
when the measuring Point voltage exceeds a preset back voltage. 

^There are various options for the input or touch screens 1 8 and 33: resistive plate 34 or its 
15 equivalent for screen 18 can be transparent or translucent and the position Point can be made 15 
by a stylus or a finger of the user, or a connecting Point of an overlapping conductivr screen 
(such as the commercially available touch screens from Touch Technology, Annapolis, MD,). 
Input screens 18 and 33 can be a physical solid surface which is transparent or translucent and 
can be glass or plastic such as Mylar. The surface can be coated with a conductive/resistive 
20 substance like indium tin oxide. Other physical surfaces can use sound or electromagnetic 20 
radiation transmission from the touched position to a reference Point or Points and the distance 
is determined by the time delay or phase shift. Alternatively, input screens 18 and 33 can use 
an ethereal or geometric surface defined by an electromagnetic, optical or sonic field. 
Position detection can be accomplished with electrical contact closure by resistive, capacitive 
25 or inductive coupling, remote sensing by sonic, electric or magnetic fields or by light (UV, IR, or 25 
microwave) scanning. 

The advantages of the low power position sensing input arrangement over other such screens 
are: (1) it makes stand-by power requirements minimal; (2) it eliminates distortion due to 
opposing parallel "bus*' bars in conventional touch screens; and (3) when a ramped voltage is - 

30 employed, it eliminates the need for an A/D chip which is a major cost factor in state-of-the art 30 
touch screen technology. 

The coefficient of friction of the screen- 18 is desirably selected to be "rough" enough to offer . 
' some resistance to the movement of stylus 16 on the screen. If the screen were too smooth, 
the stylus would slide too easily and would be difficult to control. 

35 , Reference is now made to Fig, 4 which discloses an overall system block diagram of the 35 
major electronic circuitry used in the preferred embodiment of the present invention. Microcom- 
puter 14 includes a microprocessor 50, interconnected to a plurality of other electronic elements 
by means of data path or bus 52. A Read-Only-Memory (ROM) 54 which is programmed with 
the operating and application programs and a battery powered Random Access Memory (RAM) 

40 56 is connected for bidirectional data flow onto bus 52. Microprocessor 50 may be a conven- 40 
tional single-chip erght-bit or slxteen-blt device which functions to execute the fixed control 
programs residing in ROM 54, and further receives control programs from and provides control 
signals to the other electronic elements via bus 52. Microprocessor 50 may be of the type 
commercially designated 280 (manufactured by Zilog Microcomputers of Cupertino, California), of 

45 a type 8088 device (manufactured by Intel Corp. of Santa Clara, California) or any similar or 45 
more powerful microprocessor. ROM 54 may be of the type 2564 or 4764, both manufactured 
by Texas Instruments of Dallas, Texas. The storage capacity of RAM 56 is determined in part 
by the sizes of the application programs, the operating program and the database. As discussed 
below, RAM 56 may be of the static SRAM or dynamic DRAM type. The primary requirements 

50 of RAM 56 are that K have sufficient storage capacity and that it require a minimum of input 50 
power. 

A battery 58, such as a lithium battery, provides power for making the memory of RAM 56 
non-volatile for extended periods of time. A battery pack 60 containing the well-known rechar- 
geable types of batteries is used to provide the various voltage levels required by the other . 
55 electronic elements of microcomputer 14. 55 
Alternately, the storage function of RAM 56 may be served by a non-volatile device which 
requires no power for maintaining storage, such as an electronically erasable and reprogramma- 
ble memory (EEPROM), or devices using magnetic bubbles or capacitance. State-of-the-art disk 
or tape may also be used for mass storage. Suitable bubble memory devices include types 7110 
60 and 7114 which have storage capacities of 1 megabit and 4 megabits respectively. (Both are 60 
manufactured by Intel Corp.). Furthermore, it is possible to use a single integrated circuit chip 
which includes microprocessor 50, at least part of ROM 54 and at least part of RAlM 56. 

Also connected to bus 52 is an EIA RS-232 serial interface 62 which provides a means for 
inputting and outputttng data. Data is provided to bus 52, (usually to RAM 56) by interconnect- 
65 ing an external data source to RS-232 port 62 directly to the microprocessor 50 and other 65 
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30 



elements of the microcomputer 14. Offloading data from RAM 56 can also be done by micro- 
processor 50 to an extemal computer, other data gathering device, a mass data storage device 
(e.g. floppy and hard disk dnves) or an electronic telecommunications system. In like manner 
data can be communicated through port 62. to a printer (not shown) from interconnecting bus 

5 

Stylus 16 is used to write on Input screen 18 and to cause the generation of X,Y coordinate 
information by conventional touch screen interface electronics circuitry. The coordinate informa- 
tion IS comniunicated via the bus 52 for control, use by system 10. The solid state display 20 
consisting of a multi-line display— illustratively 80 columns by 25 lines— is interconnected to bus 
10 52 through a display interface 66. The fundamental requirements for the display are that it be 10 
substantially flat and sufficiently thin for use in the presem invention. The display may be of the 
following types: scanning types such as a cathode ray tube, projected types such as a rear-view 
rK*""; emitting array of Points types (e.g., electroluminescent or plasma discharge) and 
light Wocking array of Points types (e.g„ liquid crystal displays, solid state PLTZ or magneto- 
optical). In addition, it is preferable that the display be compatible with input screen 18 in size 15 
. . . configuration and transparenpy, and that both be low power consuming types. 

The X,Y coordinates are input to keyboardless computer 14 via input screen interface elec- 
TrOM 54^and'RAM"^^^^^ "'^ ""^ *° microprocessor 50 which executes programs stored 

^° JhI^''^^^ °! u i'-^" °l ^'^ coordinates) used in defining each Handwritten Symbol 20 
and the speed at which Points are identified are important for practical utility. It is desirable to 
use at least about 4 Points per millihnetre (100 Points per Inch) and at least about 100 Pdints 
per second to define Handwritten Symbols. It is to be noted that the more Points per unit length 
that are identified, the greater the accuracy of the system in identifying Handwritten Symbol- 

25 s— however, more Points being identified will slow down the speed of identification and reauire 25 
more computer memory. Accordingly, a balance will have to be achieved, based on the size 
(available memory and processing ability) of the computer system and the requirement for speed 
mm7in°n ^1 accuracy. For most purposes, standards in the range from about 4 Points per 

30 in.w'InH ^nn l ?V !P° .^r'' ^''^"^ 8 Points per mm (200 Points per 

30 inch) and 200 Points per second will be suitable. 

It is also to be noted that the greater the precision of the system in identifying the X Y 
coordinates of each Point the fewer the number of Points heeded to be identified per unit length 
and per second to accurately identify Handwritten Symbols, Conversely the less the accuracy 
the more Poipts that are needed. ^•^^y, 

35 Point resolution is needed to place Points where intended, B.g., to write an editing symbol 35 
precisely between the two characters. Ideally, resolution to a single display pixel is deJrable 
Hovvever, operationally, resolution within two displayed pixels is sufficient for a display with 640 
pixels in a 225mm (nine inch) horizontal scanline. • 

When switch 30 (Fig. 2) is positioned to "power on", the basic display mode is activated and 
r^^.T""'"' ^^inV^ programmed by the operating system, causes a menu to be dismayed 40 
on display screen 20 (Fig. 1). The menu presents various software options. A primary software 
function, editing, functions in a manner similar to conventional word processing software with 
the difference being that handwritten characters, symbols and commands are interpreted by the 
fha they were entered from a conventional keyboard. The system is capable of learning 

45 the edrting symbols used by a particular writer for functions such as indent, insert, delete, move 
^" translates those symbols into digital command functions. Optionally; Softkeys 

nnIlnJl',TT! ^/ ^"'^'"3 ^'^^^ ^"P"* ^'^'■ee" stylus 16, function like 

conventional hard function keys on a computer keyboard 

aI^^ ^^^'r P^"''="'^'l»' ^'^apted for use as an interactive screen editor or word processor 

wifhTf cnf ^"^l^ '^T"'^"' f^°^ "^'"P"^) ^oM-^hing the displayed name of an existing 50 
file with the stylus or by writing the name of the file on the screen, all usual editing functions 
^Ih . P^"^°""^^ .""^l" "y!"« When the user wishes to change a displayed character or 

irTthi n^J^'^ wnte over the displayed character or symbol and as described hereinbe- 

low the pattern recognition algonthm will translate the written entry, into computer text For 
IT^r'n^^ » 'J^ software allows text to be eliminated by simply drawing a line through it 55 

n ?he insermndp T] ""Z "l^^ '° '^'^""9" °P^'^^'"9 '"^^^ ^o insert mode, 

irl I ."vfr^hT f L K '''^^ screen 20 provides additional space for entry of handwritten charac- 
ters or symbols which are inserted in the text after the Point where a caret was written in Text 
RO nh?==* i^oved simply by placing brackets or other user-defined delimiters around a displayed 

thl ,!! °' T """^'"^ ? "^'^^ °' user-defined symbol in the area of the text in which 60 

S ""T^^ u'PP""'- "^"^ "^^^9'"= drawing vertical lines down 

the side of the displayed text where the new margins should appear 

The basic editor software also allows new documents to be created by simply writina 

BR ^lo"^"""" Symbols on the screen. All documents can be stored, changed and communicated 

•65 in the manner in which these functions are accomplished on a conventional word processing 65 
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60 



system with the difference that these functions are accomplished with handwritten Editing 
Symbols on the (optional) screen or by touching the Softlceys with the stylus. The composite 
■ text thus produced and stored can be subsequently offloaded through the RS 232 port 62 (Fia 
4) to another computer a similar device, an external data gathering device or recording device 
5 into a pnnter or through a telecommunications system. ' 5 

In addition to these major operating modes, a number of ancillary elements and features add 
cnr^f ^ '^ ^ alphanumeric keyboard {not shown) containing a full 

set of keys can be connected to a conventional keyboard interface (hot shown) to support the 
entry of alphanumenc characters. An AC/DC power connector may also be used in those 
10 applicattons when portability is not needed and. when needed to meet the power requirements of 10 
screen technologies such as gas plasma displays and electroluminescent displays 

In actual use the keyboardless computer can function in any applicxotion or environment in 
which handwritten input translated into computer text is useful or necessary. Illustratively the 
device can function as a new generation word processor, or for use in fields such as sales 
16 nursing, inventory control, census taking, claims adjusting, to name just a few of its many uses 15 

ZXir^nn lu^??^-^?'^ education. Since the pattem recognition software 

can learn and translate into computer text from languages which are not made up of a small or 
S of alphanumeric characters (e.g., Japanese, Korean, and Chinese), it has particular 
. utility for word processing and telecommunications in these languages h 

20 In practice It Is particularly desirable to use a single computer screen to display any initial 20 
forms. Font Symbols or other, displays to be edited, and to create a neartiy -window" of blank 
space where Handwritten Symbols are to be written, displayed and identified, and where the 
Font Symbols corresponding to the Handwritten Symbols are to be displayed. In this way the 
user can view the text being edited and the proposed insert or change wiihout signifirn^ 

25 movement (if any) of the head and eyes. This is illustrated in Figs. 1 1 A to 11 D. This feature 25 

hl^w^'ly °^ ^^""^ *° ^® ^"^ ™"dow into which new text is to be 

handwntten) is very important to the simple, rapid, comfortable use of the system 
i»r nir„ -^""^ embodiment of this invention, the system "learns" the handwriting of a partiou- 
30 he airhrhl.Tl°HT^' '^°'-/'<^"lP'«' "-'"9 Ro",an alphabet, the twenty-six letters of 

I^mh'^i t ^""^ ."r^^^^'s fr*"" 0to9 would be inserted into the database. Punctuation 30 

co^S1fso^b« ln«rt!H Th 'T'"'^' "T'*'"? ^^'"'-^o'ons, hyphens and the like 

could also be inserted. There is virtually no limit to the Handwritten Symbols which can be 
recognized and stored in the database. Of course, the computer will have to store a suitable 

■iK I f^""* Symbols for conversion of the Handwritten Symbols. Different sets of Font 

bWoSl^ For l^mnTL^ p'".^ h'r'* '^"^ P«""«"«"t "'^"lory of the computer, as in ROM 35 
nnmh=t » nft* ' " M^"^'' language Usage, a chip could contain one (or more) fonts of 
rhi?^^o^.fH h f' punctuation symbols and appropriate mathematical symbols. Other 

PhinLo .r ''^ ^T*^ "?"* Cvrillic or Greek alphabets, Japanese, 

40 at ban°:ei;rrgs S'.^'S.'''' ''"^''^^'^ °^ ^ 'v-^^'^ ^ 

In Fig. 10, one of a series of learning screens, is displayed and the user is prompted to writs 

lxLinT?;.L ^Tf'^" J^' '^""""'^^ ^"^"^P* '° *he written numbers with the 

existing database (if any). If ,t cannot be matched because there is no existing database or 
because there is a poor match with an existing database, the character is added to the 
.f^hf\ ^"""^^^ continues until all of the alphanumeric (or other) characters and 45 

^^1^ ^"'^'^"^ ^^'^"^ th^ capability of storing 

multiple Stroke characterization databases for systems used by more than one user. The ews- 
tence of a unique Stroke characterization database for each user has the further advanage of 
making the wnting angle irrelevant. As a result, the system is adaptable to all handwriting styles 
and IS usable by nght-handed and left-handed persons. One feature may desirably be incorpor 50 
ated into tlie apparatus to accommodate left-handed and right-handed persons This fea^re a 
receptacle (not shown) for the stylus connector on either side of housing 12, so tKrsty us 
handTd^e^ons""^ °" '^^ ^'"^ left-handed persons and on the right side for righi- 

!!^° P™v'''«s an. example of the use of "Softkeys". In addition to the input line a 55 
variety of Softkeys appear. Each Softkey corresponds to a function that can be performed by 
Z, n»n Th <:°ll^' to execute the function, the user merely touches the indicated Point with 
tLI™ ^^"--^ ^ T ^ ^PP^°' '^"^'^^ selected function is performed 

There are numerous advantages to Softkeys over traditional function keys. Some of the more ' 
significant of these are that the user is no longer required to memorize what function key 60 

h! mLnf ^^."^^"^ ''^y^"^'^^ eliminated: and different Softkeys can 

be made availab e (displayed and made operational) at different Points within a program. 
*;™.^"hlK ^° V ^^"^"^fates some of the simplifications in word processing made possible 

*1 fe«vh ^ '"^'^ ^ ^ ^^^"'^^^'^ ^'^^^^^ °f displayed. The user of 

65 the keyboardless entry system decides that additional information needs to be added and draws 65 
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an rnsert symbol (e.g., caret) on the screen at the desired positijon. A data entry ''window" then 
appears. (Fig. 11B). The text is written in as Handwritten Symbols (Fig. 11C), matched (con- 
verted to Font Symbols) (Fig. 11D), and then inserted (Fig. HE). The operator reconsiders the 
a 3"^,^^^^^^ horizontal line through the new material. (Fig. 11 F). It is Immediately erased 

5 (Fig. 1 1G}. Next, the operator decides that a larger right-hand margin would be more appropriate 5 
for the text. A vertical line is drawn on the screen (Fig. 1 1H) and the margin is automatically 
adjusted {Fig. 1 11}. ^ i 

A generalized block diagram of the editing process is provided in Fig. 13 and a description of 
that figure appears hereinbelow. 
10 Figs. 12A-12G illustrate how a blank form may be used for a hospital patient. The user of the 10 
system first calls up the proper blank forni (Fig. 12A). This may be done, for example, by 
touching an appropriate Softkey. The area where the information, in thfs case a pulse observa- 
tion, IS to be inserted is touched with the pen (Fig. T2B). After the desired location is high- 
'1-^^^?;^/'^'"^°^" appears directly, below the space where the observation is to be recorded 
i o?;. 1 """^^^ touches the pen on the match box which appears highlighteci (Fig 15 

12D . The software then matches the handwritten input to the corresponding Font Symbols and 
disp ayes the result (Fig. 12E). If there is an accurate match, the "insert" block is touched (Fig 
12F) and the new observation is added to the patient's records (Fig. 12G). This mechanism is 
clearly applicable to a wide variety of "blank forms" in which data is inserted into a forni or 
20 corrected. For example, it could, be used to correct or update financial information in a spread- 20 
sheet problem. Other information can be recorded in the same manner. 

The reason for using a bfack background and white letters for the newly entered Font 
Symbols is to facilitate checking the accuracy of the inputted character. Although this is prefer- 
able, It IS not essential and a while background and black fetters is also acceptable. 
25 The ability to create a window and input data on the same screen and in physical proximity to 25 
the text being edited or space for data to be input is an important feature of the apparatus for 
It permits ease and speed in the use of the apparatus.. Thd user's' eye may focus on the space 
where the data will be inserted and the ability to contemporaneously display Handwritten Sym- 
bols and the corresponding Font Symbols makes it easy to see errors, when the system 
30 misreads" a Handwritten Symbol, and then correct errors quickfy and easily 30 
Referring first to Fig. 5, the overall operation and functioning of the pattern recognition 
software will now be described. When the operating system calls the pattern recognition 
program, the program begins in terminal 75 where a number of variables and counters are 
initiahzed. The software then pmceeds to decision diamond 76 where the program determines if 
35 stylus 16 (Fig. 2) is in contact with input screen .18 (Fig. 2A). The system provides a "pen 35 
down signal as shown in processing box 78, as well as the X,Y coordinate voltages as 
ocating signa s, as described above. Microcomputer 14 (Fjg. 4) converts the X,Y coordinate 
locating signals into Stroke characteristics using programs stored in ROM 54 (Fig 4) or a 
separate microcomputer can do the conversion, such as microcontroller 44. If a pen down siqnal 
40 IS received, the software proceeds to processing box 80 where the individual locating signals are 40 
combined into Strokes," a stroke being defined as the Point locating signals produced between 
a pen down' signal and a "pen up" signal. 

The system then calculates a transform, as described below, for each Point, transforming the 
Point coordinates from the X,Y cartesian coordinate system to a relational coordinate system 
45 The software next proceeds to proeessing box 82, where it compares the Stroke with previ-* 45 
ously entered Strokes accumulated into a database, and determines if the Stroke is represented 
by a symbol in the database. If a match is found (if the Font Symbol represented by the Strokes 
is recognized), as indicated in decision diamond 84, microprocessor 50 (Fig, 4) causes the 
symbol to be sent to display screen 20 (Fig. 4) as indicated in processing box 86. If a match is 
50 not found, microprocessor 50 (Fig, 4) causes a message to be displayed, as indicated in 

processing box 88, which requests further input from stylus on Input: screen 18 (Fiq. 4) bv either 
flashing an entry which is close to a match or a non-recognition symbol 

As mentioned above, the software compares the- Stroke characteristics of each Handwritten 
Symbol to data entnes previously stored in a database. In a preferred embodiment, the database 
55 IS arranged into sections of characters or symbols by the number of Strokes needed to make 55 
the character or symbol. Within each section, the entries are randomly arranged at first but 
after use, as explained herein, the most frequently used entries 'Vise" to the top of the 
database. It should be noted that each ;user will have his or her own particular style of writinq a 
Handwmten Symbol and that each Handwritten Symbol may. have a number of different varia- 
bU tions. 

For example, many people write the lower "case letter "h" using a single Stroke They do this 
by starting the pen on the writing tablet at a Point where they wish to place the top of the 
letter, drawing a vertical line downwardly to the base line, then without removing the pen from 
• the paper proceeding back up to the midPoint of the previously drawn vertical, line, over to the 
b5 nght and down to the base line when the pen is picked up from the paper. On the other hand 65 
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these same people may draw the upper case letter "H" using two Strokes. They do this by 
drawing the left hand vertical line and horizontal line as is done for the lower case *'h", picking 
the pen up from the tablet, and then drawing the right hand vertical line. Appendix I displays the 
data of the Stroke data Points for these two letters as the data is stored in memory after having 
5 been generated by an embodiment of the present invention. 5 
As shown In Appendix I, the letter "h" as drawn at one particular time by one user has one 
Stroke (ns=1) with 20 Points (np=201 and x and y coordinate characteristics for the minimum/ 
mean and nnaximum normalized values (l/80tb. of a line width) as follows: —17 and -6; 0 and 
18; and 19 arid 60, respectively. The values in the first vertical column are the Point-to-PoInt 

10 slopes, normalized to 360°/256. The values in the second vertical column are the Point-to-Point 10 
average vertical positions above the base line, normalized to 1/80 of the line width. A typical 
line width Is about 1mm (0.04 inches). 

Referring now to Fig. 6, a software hierarchy of programs Is depicted. At the top> overseeing 
the entire operation of computer system 10 (Fig. 1), is an operating system as indicated by box 

15 90. Applications programs shown in boxes 92 and 94, residing in RAM 56 (Fig. 4) and ROIVI 54 15 
(Fig. 4) can be executed by microprocessor 50 (Fig. 4) under control of the operating systems. 
When a Handwritten Character is required or is indicated by an interrupt, handwriting recognition 
software 96 is Called. A first subroutine, indicated in box 98, encodes the X,Y coordinates into 
Strokes. The characteristics of the Strokes are then defined by a subroutine 100 followed by 

20 comparisons of the Strokes with a database that has been loaded from ROM 54 (Fig. 4) into 20 
RAM 56 (Fig. 4). The comparison is made by a subroutine 102. When the operating system is 
in the "learning" mode, the database is updated with the new Stroke data and symbols, as 
indicated in box 104. Similarly, a previously stored document can be edited by applications 
program 92 by using edit function 94 as called by the operator, who provides the Instructipns 

25 as input using the subroutines 98, 100 and 102 of handwriting recognition program 92. 25 
Referring now also to Fig. 7, operating system 90 (Fig. 6) executes the Handwritten Character 
recognition software 96 (Fig. 6) by accepting as input the X,Y coordinate Points, depicted in box 
110, of the position of stylus . 16 (Fig. 2) on input screen 18 (Fig. 2) and encodes these Points 
into Strokes as depicted in box 112. The program then characterizes the Strokes by some 

30 description set, such as considering the length, curvature, slope, and position of the Stroke, as 30 
depicted in box 114. In box 1 16 the best comparison is then found of the characterized Stroke 
or sequence of Strokes with those in the database. If a sufficiently close match is found,, the 
icharacter is identified in box 1 1 8 and the database entry is swapped with the entry above it as 
shown in box 120. In this way, the most frequently identified characters will "rise" to the top 

35 of the database and the overall system performance, as measured in time to find a match will 35 
be increased. If a match is not found, the user can add to the bottom of- the database, as 
indicated in box 122. 

With reference now to Figs. 8 and 9, a flowchart of the computer program to recognize a 
particular Stroke sequence is set forth. The computer program begins in terminal 150 and 

40 proceeds to process the X,Y voltages from processing box 1 52, the voltages having been 40 
converted to a digital signal. The program then proceeds to decision box 154 where the 
program determines whether the pen or stylus 16 (Fig. 2) is out of contact with input screen 
18. This determination is made by both the X voltage and the Y voltage being zero. If the 
program determines that the pen is up, then the Stroke is determined as having been completed 

45 and the program branches to decision box 156. In decision box 156, the program determines 45 
whether there are less than three Points in the Stroke and if so the program branches to 
decision box 158: In decision box 158, the program determines whether there are zero Points \n 
the Stroke. If there are zero Points in the Stroke, then the program loops back to the beginning 
of processing box 152 where another set of Points Is read. If the Point counter (incremented in 

50 processing box 164) indicates that there are more than zero Points, the program branches to 50 
processing box 172i In processing box 172 the Stroke is identified as a dot and its height 
above the base line (HABL) is calculated in processing box 173. From processing box 173 the 
program proceeds to processing box 171. 
However, if the pen down signal is received, the program branches to processing box 160 

55 where the voltages are scaled to determine the coordinate Point using the following formulas: 55 

60 60 
The constants a, and b, are scaling parameters that are determined from calibrating the input 
surface of the particular display. 

Once the voltages are scaled, the program proceeds to decision diamond 162 where the 
program determines whether it is an erroneous Point. This is done by comparing the distance 

65 between Points and eliminating a Point if the distance is to great (greater than 2.5mm or 0.10 65 
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inches is presently used). On the other hand, a Point is also eliminated if the Points are too 
close together. Points are presently thinned out if they are within about 0.4mm (0.015 inches). 

The comparison problem that exists for the first Point is resolved by determining if a Point is 
the first Point after a pen is down and then that Point is used only to check the next Point 
5 which is accepted, assuming that that Point is within the maximum distance of 2.5mm {0.10 5 
inches). 

If the distance between Points is determined as being outside the two criteria, the program 
drops the Point and branches back to the top of processing box 152 to read another pair of 
coordinate Point voltages. 

10 On the other hand. If the Points fall within the criteria, the program continues to processing 10 
box 164 where a Point counter is incremented to keep track of the number of Points. This 
number is used in decision diamond 1 56, as mentioned hereinabove. The program then contin- 
ues to processing box 1 66 where the Points are smoothed according to any one of a number of 
fomiulae. Smoothing is used to minimize noise from digitization, from erratic hand motion and 

15 from electronic noise. The simplest smoothing technique is a multiple Point average which 15 
results in calculating new Points lx{y{) as follows: 

"2 • . . 

And similarly for y,' smoothed oyer Points ni— n^. 
25 Another simple method is called the running weighted average method and utilizes the follow- 25 
ing formula: 



Xj'— o[X,+ (1 ^a)X|'., 

30 Alpha is a weighting constant that is usually positive (and less than one) and has been used at 30 
0.25. The summations have been taken with n^ minus n, equal to one. A third method involves 
what Is called a spline fit wherein the following formula is used: 

x;=(X(.,-f-4x,-fXj^,) 

3^ 35 
Any of the foregoing methods can. be applied either before or after filtering. The filtering is 
done so as to reduce the number of input Points and to space data so that difference and/or 
angle calculations can be made within acceptable random error bounds. A simple process of 
thinning a sequence of Points by excluding the acceptance of subsequent Points within a set 

40 distance of the previously accepted Points has been found to be an effective filter. 40 
From processing box 166, the program proceeds to processing box 168 where the Point is 
stored in an array tfiat Is incremented for each new Point since the last pen down signal. Thus, 
an addressable array of Points is created for each sequence of Points obtained from a pen dovvn 
to a pen up signal. This sequence of Points is called a Stroke. From processing box 168, the 

45 program loops back to the top of processing box 1 52 where another Point is obtained until a 45 
pen up signal ends the Stroke, 

In decision diamond 156, a determination was made as to whether there were less than three 
Points in a Stroke. By definition, if there are three or more Points in a Stroke, the Stroke is a 
line and not a dot. If there are three or more Points in the Stroke, the program branches to 

50 subroutine box 170. In subroutine box 170, discussed in greater detail hereinbelow with respect 50 
to Fig. 9, the Stroke is characterized as to its slope and base line height. 

As can, be seen from the foregoing, the segmentation of the stream of coordinate Points into 
a Stroke is based primarily on the determining when stylus 16 is "up" or not in contact with 
the surface of input screen 18. Alternatively, a stream of Points can be segmented to form 

55 Strokes on the basis of other considerations. For example they can be segmented based upon 55 
changes in a locally calculated curvature or upon a large local curvature. Local curvature is 
calculated by the change in distance along the input coordinates divided into the change in 
slope. This produces radius of curvature. When the radius of curvature changes rapidly with 
respect to distance along the input coordinates, or if the radius is too small, then a segmenta- 

60 tion Stroke is assumed to end, and a new Stroke begun. Further segmentation techniques can 60 
look at the relative maximum and minimuni rn one or both coordinates and/or the curve 
crossings In the coordinates. However, these latter two methods have been detennined to be 
less effective. 

Characterizing a Stroke reduces the sequence of coordinates defining the Stroke or segment to 
65 a set of characteristics that are unique, generalized and minimal. Uniqueness refers to both .65 
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factors that the same characteristics are generated by the same coordinates and that the 
characteristics are sufficient to regenerate an approximation to the original coordinate sequence. 
The term "generalized" is used to mean that the characterization Is Invariant under such trans- 
formations so that the symbols are invariant (e.g.. translation and scaling or stretching or small 
5 tilt). The scaling of all distances is accomplished by taking a ratio of the distance to a writing . 5 
entry line width. 

The minimal set of segment characteristics have the following features: 
|1| Stroke position: one or more of centroid/average, extent extreme or beginning and ending 
Points determined relative to the writing entry line, to previous Strokes, or to character extent or . 
10 center; 10 
(2) Stroke shape Is characterized by one or more of average slope, change in slope (which is 
a measure of average curvature) and/or a change in curvature, by sequence of slopes over 
specific length segments or over fractional lengths, or by a gross description of linear direction 
or circular completion and operating direction; 
15 (3) And Stroke length as characterized by distance along the curve and/or the extent extre- 15 
mum along the coordinate system. 

In one embodiment of the present invention, positioning by centroid, extent extremum, and 
starting and ending coordinates have been successfully used. The Stroke shape is encoded as a 
sequence of slopes and vertical positions (relative to Stroke centrold). The Stroke length can be 
20 approximated by the number of filtered Points, Alternatively, the average curvature can be 20 
encoded in total slope change (along with length), change in starting to ending slope or fitting 
the slope angle versus length curve for rate of change of slope angle. Additional characteristics 
that Gould be used include location of coordinate relative extreme, curve crossing, cusps, and 
Stroke direction. A particular method used to determine the unique characteristics is set forth 
25 below. 25 

1 . The numerical values of the Criteria for each Stroke of the Handwritten Symbol are 
determined. 

2. The database values for each stroke of the previously learned Handwritten Symbol is 
determined and subtracted from the newly determined values respectively. 

30 3. The absolute values of each difference are scaled, to make each of the five measurements 30 
reasonably equivalent to the others such as lengths scaled to height between, lines. 
4. The five thus-determined values are added. 
' 5. A predetermined threshold is used as "goodness" test of recognition — too high a value 
and Font Symbols are infrequently recognized and too -low a value causes Font Symbols to be 
35 mi^sidentified, Thresholds of approximately 1,000 are used initially and then switched to approxi- 35 
mately 100 for improved recognition. If the threshold is exceeded, the comparison is discarded 
and an error message is created and displayed. 

6. The database is searched to find a numerical minimum difference. If the minimum differ- 
ence is below the acceptable threshold for recognition, the corresponding Font Symbol is 
40 displayed on the screen or the command is performed, as the case may be, 40 
It has also been found that the preferred classification of a Stroke is a continuous one, rather 
than one that is grossly discrete. For example, determining a slope by angle in 256 directions 
rather than in 8 is desirable. Other non-continuous classifications can include bars/arches/hooks, 
number and closure of cusps or horizontal or vertical Strokes. 
45 From subroutine 170, the program proceeds to processing box 171 where both an individual 45 
Stroke and one or more preceding Strokes are compared with a database entry that is stored in 
RAM 56 (Fig. 4). 

This comparison initially begins with three eliminating questions that are asked by the program 
in decision diamonds 174, 176, and 178. In each case, if the database entry is eliminated, the 

50 program proceeds to a processing box 1 80 where the address of the next data entry is received 50 
and from which the program loops back to the top of processing box 171. In decision diamond 
1 74, the first eliminator is asked by seeking If the number of Strokes are different. If the number 
of Strokes are the s.ame, the program proceeds to decision diamond 176 where the average 
Height Above Base |.ine (HABL) is calculated and compared with the HABL of the data entry. 

55 The entry is eliminated if the difference in the average HABL's is greater than one-half the height 55 
of the entry line. From a negative determination in decision .diamond 176, the program proceeds 
to decision diamond 178 where the number pf Points per Stroke are compared and the database 
entry is eliminated if the difference in number of Points is greater than ten. This determination 
varies from that made in decision diamond 1 74 because it is concerned only with the number of 

60 Points for each Stroke. However, in decision diamond 174, certain letters, such as the capital 60 
letters "E" and "A", have more than one Stroke per letter. 

If a data entry is not eliminated by decision diamond 178, then the program proceeds to 
processing box 182 where the program calculates a gauge to be used to determine the 
closeness of the match between the selected entry in the database and the drawn Stroke. A 

65 presently preferred gauge is the sum of the absolute values of the differences between the 65 
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Stroke values and the database entry values of: 
(a| distances or lengths n units of 1/80th of the line height (e.g„ space 26, Fig. 2); and 
(b) the slopes in units of 1/256th of 360° over all the Points along the diagonal of the 

comparison matrix. 

5 Alternatively, Dynamic Programming Techniques can be used to optimize the comparison using .5 
off-diagonal elements a$ well. 

From processing box 182, the program proceeds to decision diamond 186 where a match is 
detennined. In actuality, a match is determined by the application of an arbitrary gauge (maxi- 
mum allowable variance), which is the sum of absolute values of the differences between the 

10 entered Stroke characterization and that of the stored database entry. In processing . box 183, 10 
the lower of the present gauge and the previous lower gauge is saved best match. The program 
then goes to decision diamond 184 where a determination is made whether the present entry Is. 
the last database entry. If it is not, the program branches to processing box 180 where the next . 
entry is selected. If it is the last entry, the program proceeds to decision diamond 1 85 where a 

15 determination of a match is made on the basis of the gauge being below a predetermined 15 
threshold. This threshold is set by the user based on experience with the system. 

If ho match is obtained, the program branches to decision diamond 188 where a determination 
is made whether all Strokes have been checked. If the last Stroke has been checked, then the 
present Stroke is compared in sequence with a previous Stroke to all two Stroke entries. As in 

20 the comparison with all One Stroke dictionary entries^ the best, fit comparison for all entered 20 
Strokes is the recognized symbol or sequence of symbols. 

However, if the last Stroke has been read and there still is not a match, then the projgram 
proceeds to processing box 190 where a question is displayed on display screen 20 asking the 
user if a new Font Symbol should be added to the database. The user responds and that 

25 response is used in decision diamond 192. Either the Stroke sequence is added to the database 25 
in processing box 194 and the program branches back to the top of processing box 152, or the 
program branches immediately to the top of processing box 152. 

On the other hand, if a match is determined in decision diamond 186, the program branches 
to processing box 195 where the program shuffles the database by interchanging the serial 

30 location of the matched entry with the entry above it. The program then proceeds to processing 30 
box 196 where the program zeros the Point counter and the increment counter. The program 
next proceeds to processing box 198 where the matched and characterized Stroke or Strokes 
' are displayed by the computer as the identified Font Symbol. This display is located at the 
position in which the entry was made on input screen 1 8 {Fig. 2). 

35 From processing box 198, the program proceeds to processing box 200 where the program 35 
can act on any commands which it has interpreted. An alternative characterization of the Stroke 
uses the Points themselves rather than the length, scope; curvature and position. 

With reference now to Fig. 9, this Stroke characterization is depicted in greater detail. Stroke 
characterization subroutine 170 essentially performs a mathematical transformation of each Point 

40 on a Point-by-Point basis to transform the Points from an X,Y Cartesian coordinate system to 40 
one in which the coordinates are the normalized slope of each Point and the normalized height 
of each Point above the base line (HABL). 

Subroutine 170 first calculates the Point to Point slope in processing box 220 and then 
calculates the height of each Point above the base line in processing box 222. The slope and 

45 HABL of each Point are then normalized respectively to 1 /256th of 2 Pi and to 1/80th of the 45 
width of the entry lipe in processing box 224. From processing box 224, the system proceeds 
to processing box 226 where the calculated normalized values for each Point are stored in an 
addressable array. The subroutine then returns to the program through terminal 228. 
When the comparison is made between each Stroke and the stored values, the comparison is 

50 made by the normalized Point slope and Point height above base line. As mentioned above, a 50 
match is determined by an arbitrary gauge which is the sum of absolute values of the dlffer- 
. ences between the written Stroke and the stored or dictionary Stroke. The system learns by 
adding new Strokes to the dictionary database. Once the database fills up, those Font Symbols 
that are infrequently used are replaced by new entries. 

55 In a working embodiment of the present invention, the algorithm successfully Identified upper 55 
and lower case letters and numbers when written discretely from one another. For Handwritten 
Symbols that are written such that they are continuous, direct extrapolation would require 
searching a d&tabase sequentially for one, two, three, etc. Stroke symbols and looking for the 
best fit. Upon identification of a Stroke fit, a "new" letter Is tenatively recognized, except that 

60 the next few Strokes are analyzed to check if they change the previous symbol for a better fit. 60 
For example, two Strokes that have been identified as "ones" would be combined and changed 
to the capital letter "H" once a cross bar was identified. 

The system design demonstrated by Figs. 7 to 9 could easily be coded by one with ordinary 
skill in the art of computer programming into ainiost any computer language. The source code 

65 listings for one application program utilizing the disclosed invention is included as Appendix II. 65 
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The software in Appendix II is written in Microsoft Basic, a common computer language avail- 
able for virtually all microcomputers and operating systems. The program is a complete text 
editing demonstration, which shows the improvements that can be made upon traditional word 
processing systems. 

5 Program lines 2600 to 4000 contain the character recognition subroutine which includes the S 
software code necessary to get X and Y coordinates. This section of the program corresponds 
to Fig. 8. 

Program lines 2600 to 2699 make up a subroutine designed to obtain the X and Y coordi- 
nates of a given Point. This code con-esponds to boxes 152, 154, 160, 162, 164, 166 and 
10 168 of Fig. 8. 10 
Program lines 3000 to 3339 constitute a Point and Stroke analysis and characterization routine 
embodying boxes 156, 158, 170, 172 and 173 of Fig. 8. 

Program lines 3700 to 3790 make up a subroutine designed to compare the analyzed Strokes 
to a Stroke database. These program lines embody boxes 171 to 184 of Fig. 8. 
15 Program lines 3810 to 3980 make up a subroutine which is designed to learn a new 15 
character. This code ennbodies boxes 186, t88, 19D, 192 and 194 of Fig. 8. 

Program lines 3060 to 3273 make up. a subroutine designed for Stroke characterization 
purposes. This section of the code corresponds to Fig. 9. 
Program lines 3060 to 3095 are used to calculate Poiht-to-Point slopes and embody box 220. 
20 Program lines 3058, 3241 and 3262 are used to calculate a height above baseline (HABL) and 20 
correspond to box 222 of Fig. 9. 

Programs lines 3253, 3270-3273 are used to normalize the Point height and slope and 
correspond to box 224 of Fig. 9. 
Program line 3253 is used to store the height above baseline and embodies box 226 of Fig. 
25 9. 25 
The foregoing program can be stored in the memory of a microcomputer of microprocessor 
with a requirement of approximately 25K of machine memory, so that it can be seen that the 
use of the program does not use up a lot of expensive memory and is relatively fast in 
executing the program's operation; If the program is written in a language other than Basic, 
30 requiring less memory, such as assembly language, the size of the program can be made 30 
smaller. 

Boxes 195 to 200 of Fig. 8 appear in logical places throughout the code. 
A dictionary of the variables of the relevant code section is included as Appendix III. 
I W\lh reference now. to Fig'. 13, a flowchart for the editing software {"Editor") demonstrated 
35 by Figs. 1 1A to 111 and described above is depicted. Once the Editor is loaded into the system 35 
(box 229), control of the screen Is returned to the system. The system then proceeds in the 
' normal manner described above to acquire Points and display them (box 230), convert the 
Points into Strokes {box 231), characterize each Stroke (box 232), and attempt to match the 
Stroke or Strokes with the database (box 233). In processing box 234, the system sends each 
40 Handwritten Symbol, to the Editor to interpret and execute a command if necessary. At decision 40 
diamond 235, the Editor determines whether the Handwritten Symbol is an Editing Symbol or a 
Font Symbol. If the character is determined to be an Editing Symbol, the Editor proceeds to 
processing box 236 where it determines which Editing Symbol has been entered and executes 
the' Editing Function. If the character is determined not to be an Editing Symbol, then the 
45 alphanumeric character corresponding, to the handwritten entry is displayed at processing box 45 
237. In an alternate configuration of the Editor, Font Symbols will only be accepted when the 
Editor is in the "Insert Mode"; This stmcture insures that each Font Symbol is verified before 
being added to a document. 
The Editor uses a variety of symbols designed to make editing on the system similar to, but 
50 much more efficient than, traditional editing with pencil and paper. These primary editing func- 50 
tions include, but are not limited to: 

DELETE symbol — " " A horizontal line drawn through a character or characters. The 

Editor will remove the underlying characters and reformat the text. 
ADJUST MARGINS symbol — *'|" A vertical line longer then the height of one line on the 
55 display. The Editor will adjust the margin to the indicated poshion and reformat the text. 55 
INSERT symbol — "A" A caret drawn at the Point where text is to be added. The Editor 
displays an input writing line {Fig. 118) and when input is recognized inserts it into the text. 

MARK TEXT symbols: — and ">" A less than and greater than symbol drawn at the 
beginning and end of a block of text. The marked text is displayed in reverse' video and then 
60 special block functions can be performed. 60 
DELETE MARKED TEXT — A delete symbol drawn within marked text will erase the marked 
text and a reformat. 

MOVE MARKED TEXT — An insert symbol drawn anywhere within the text moves the marked 
text to the indicated position, deletes it from Us original position and refomiats the text. 
65 REPLACE MARKED TEXT— An insert symbol drawn within the marked text displays an input 65 
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. line and replaces the marked text with the inputted text 

The Editing Symbols described above can be changed to the Dartlcular Fditinn <5x,mh^i., 

ewracted and organ«ed into a synthetic symbol. The. synthetic symbol's charac eriScs Lid 
then be exaggerated to maximize their variance from all other synthetie svmtwls TO^wn^^^^ 
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APPENDIX I 
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APPENDIX III 



Al " angle of slope between Point M and Ml 
A2 - previous angle 

5 DAI . change in angle (A1-A2) 5 
.SEND - flag for end of Stroke 

ZX - double precision X position summation by arc length weighting 
2V - double precision Y position summation by arc length weighting 
2/v - double precision angle sxuiunation by arc length weighting 
10 ZDA - double precision change in angle summation 
2L - double precision length 
N5P - number of Points in Stroke, counter 
NSTRK - number of Strokes 
XX - maximum X 
XN- - minimum X 

15 yx - maximum Y " 15 

YN - minimum Y' 

Ml - Pointer to previous Point 

M2 - (1) minimum number of Points for which to adjust for 
271 angle . 

20 - (2) minimum number of Points for which to calculate change 

in change in angle ' 20 

NLONG - counter (not used) 

K - Pointer to Point being considered 

NP - number of Points 

X - array of X coordinate 
25 Y - array of Y coordinate 25 

DX - change in X . 

DY - change in Y 

ADX - absolute Value of DX 

ADY - absolute, value of DY 
20 - pseuco arc length ADX + ADY 

AY - calibration muitiplier for vertical (Y) direction, e»g. 30 
AY * O mean coordinate system true downward 

ADA - running average change in angle 

DA2 - previous change in angle 

ASTKT, - E^rray for starting angle of Stroke 
35 SZL - single precision Stroke length 3g 

SND - array of number of the 1st Point for each Stroke 

LHT5 - height between lines divided by 5 in display coordinates 
used as a measure 

SL - array of Stroke lengths sealed to height between lines 

AEKD - array of angles at end of Strokes 

5C - array of angle changes for eachs troke 40 
A2A - average angle through Stroke 

SX - array of averages centroid X coordinate for each Stroke 
SY - array of averages centroid Y coordinate for each Stroke 
SA - array of averages angle (slope) coordinate for each Stroke 
45 SXX - array of maximum X coordinate for each Stroke ac 
SXN - array, of minimum X coordinate for each Stroke 
SYt^ - array of minimum Y coordinate for each Stroke 
SYX - array of maximum Y coordinate for each Stroke 
DBUG - debugging flag for printing 
INPUT - string of input bytes to be rejected 

XP, YP - input coordinates 50 
XPA - average 2 Points in X direction 
YPA " average 2 Points. in Y direction 
XPO " initial X average on pan down 
YPO - initial Y average on pan down 
55 I - display pixel cotresponding to X coordinate input 55 
J - display pixel corresponding to Y coordinate input 
N - counter of input Points 

MM - counter for -timing pan up . * 

NU " counter for timing pan up 
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CLAIMS 

1. An input/output or I/O device for providing input signals to a utilization device that are 
representative of a graphical character produced by a user and for receiving output signals from 
the utilization device and providing a visual representation of the output signals, said I/O device 
5 comprising: 5 

(a) a display means for providing a visual/display of a graphical character in response to 
output signals provided by the utilization device; 

(b) an input screen means for producing a train of input signals as a graphical character or 
symbol is sketched by a user, said input screen means comprising a translucent input screen 

. 10 having top and bottom surfaces, said bottom surface being disposed with respect to said 10 
display surface such that the visual display produced by said display means Is visible from said 
top surface of said input screen; and 

(c) means for detenmlning the identity of said graphical character and providing output signals 
representative thereof to said display means, 

15 2. An I/O device as claimed in claim 1 wherein said display means comprises a display 15 
surface on which the graphical character Is produced; and 

said input screen means bottom surface is disposed in close projcimity above, said display 
surface such that the visual display produced by said display means is visible from the top side 
of said input screen^ 

20 3; An I/O device as claimed in claim t wherein said Input screen means includes a substan- 20 
tially flat plate, and wherein said input screen top surface Is the top surface of said plate. 

4. An I/O device as claimed in claim 3 and further including an including an indicating means 
operated by a user for cooperating with said Input screen top surface such that said input 
screen means generates sard train of input signals when said indicating means is in a predeter- 

25 mined position with respect to said plate top surface. 25 

5. An I/O device as claimed in claim 4 wherein said input screen means generates an input 
signal when said indicating means is in contact with said input screen top surface. 

6. An I/O device as claimed in claim 5 wherein: 

(a) said plate has electrical characteristics such that the voltage at any Point thereon varies In 

30 a known manner with the distance from the location at which a voltage is applied thereto; 30 

(b) said input screen means further includes means for selectively sequentially applying a 
voltage along one Cartesian axis of said plate and then along the other Cartesian axis of said 
>plate; and 

c) said indicating means is elongate and has a tip at one end thereof and includes a voltage 
35 detecting means that provides a signal representative of the voltage present where said tip 35 . 

contacts said input screen plate. 
7: An I/O device as claimed in claim 5 wherein: 

(a) said plate has electrical characteristics such that the voltage at any Point thereon varies in 
a known manner with the distance from the location at which a voltage is applied thereto; 
40 (b) said input screen means further includes means for selectively sequentially sampling at an 40 
origin thereon the voltage along one Cartesian axis of said plate and then along the other *' 
Cartesian axis of said plate; and 

(c) said indicating means is elongate with a tip at one end thereof and include a means for 
applying a known voltage to said tip; said sampling means detecting the voltages at said origin 

45 when said tip contacts said input screen plate and provides a signal representative of the 45 
detected voltages. 

8. An I/O device as claimed in claim 2 wherein said display screen has a display area on 
which graphic symbols can be generated and a key input area by which command signals for 
the utilization device can be generated when contact is made with the corresponding area 

50 thereabove on said input screen. 50 

9. A handwriting character recognition apparatus comprising: 

(a) a display means having a display surface for providing a visual display of graphical . 
characters in response to a plurality of display signals; 

(b) a writing surface means for receiving graphical characters handwritten by a user, said 

55 writing surface means being disposed in close proximity with respect to said display means and 55 
comprised of a substantially translucent surface which has positional coordinates associated 
therewith; 

(c) an indicating means operated by a user in connection with said writing 'surface means for 
producing writing signals in cooperation with said writing surface means; 

60 (d) position detecting means for converting said writing signals into locating signals represen- 60 
tative of the positional coordinates of said Indicating means with respect to said writing surface; 

(e| a processing means for receiving and storing said locating signals as they are. produced 
and for generating said display signals such that said display means can graphically display the 
graphical character after it has been produced by said indicating means; said processing means 

65 being comprised of a character recognition means for comparing safd produced locating signals ' 65 
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representative of a graphical character with a plurality of stored database signals for identifying 
said graphical character, s. 

10. A handwriting character recognition apparatus as claimed in claim 9 wherein said writing 
surface means includes a feubstantially flat plate which produces a signal when said indicating 
5 means is in contact therewith. ' ^ 

n . A handwriting character recognition apparatus as claimed in claim 9 and further including 
means for converting said positional coordinates into relational coordinates. 

12. A handwriting character recognition apparatus as claimed in claim 11 and further includ- 
ing means for dividing up a stream of locating signals into sections representative of a Stroke; 

10 and means for calculatfng Stroke characteristics which can be compared with Stroke character- 10 
istics of the database signals. 

13. A handwriting character recognition apparatus as claimed in claim 9 wherein said pro- 
cessing means further includes means for updating said stored database signals whh said 
produced locating signals when no correct graphical character is Identified. 

15 14. A method of recognizing a Handwritten Symbol comprising the steps of: 15 

(a) generating a stream of locating signals for Points by moving a stylus about locations 
proximate to a writing surface means that generates a signal representative of said location of 
said stylus; 

(b) dividing up a stream of locating signals into sections representative of a Stroke; 

20 (c) calulating Stroke characteristics; 20 
id) comprising said calculated Stroke characteristics with Stroke characteristics previously 
stored in a database; and 

|e) ■ determining the best comparison and indicating if said best comparison is good enough to 
be a match. • " 

25 15. Apparatus for. recognizing Handwritten Symbols and displaying Handwritten and Font 25 
Symbols on a screen comprising: 

(a) A visual display screen, having the graphic capability to display Font Symbols and execute 
predetermined commarids; 
{b) Hand-held means to write or draw Handwritten Symbols on or over said screen; 
-30 (c| Means to display a true representation of the Handwritten Symbols on said screen as they 30 
are created; 

(d) Digitizing means: to sense the position of said hand-held means and to convert the same 
into a series of electrical signals defining the position, size and shape of each Handwritten 
Symbol; 

35 (e) Means to compare predetermined characteristics of each digitized Handwritten Symbol 35 
with a database of predetermined characteristics of Font Symbols to assess the identity of each 
Font Symbol; 

(f) Means to convert the Handwritten Symbol to a predetermined Font Symbol or a command 
and to display the Font Symbol on the screen, in close proximity to the screen area in which the 
40 Handwritten Symbol was originally entered or to execute the command, as tho case may be. 40 

16. Apparatus as -set forth in Claim 15, Including means to display predetermined fonts of 
symbols in the form of text or forms on said screen, whereby the Handwritten Symbols can be 
used to input information to complete a form or to edit a predetermined text. 

17. Apparatus as set forth in Claim 15, wherein said apparatus comprises a portable unit 

45 having dimensions up to about 400mm by 400mm by 100mm, a weight of up to about 7 45 
kilograms and is adapted to include a self-contained power supply. 

18. Apparatus as set forth in Claim 15, including means to display predetermined symbols in 
a font and command-representing symbols on said screen, to permit handwritten symbols 
representing each predetermined symbol to be manually defined on the screen and means to 

50 identify the manually defined symbol with the corresponding predetermined symbol in said data- 50 
base. 

19. Apparatus as set forth in Claim 18, including means to modify said database when a 
Handwritten Symbol Causes an erroneous Font Symbol to be displayed on the screen or com- 
mand to be performed, as the case may be. 

55 20. Apparatus as set forth in Claim 16, including means to create a window of empty space 55 
on said screen upon a predetermined command for entering Handwritten Symbols in said 
window. 

21. Apparatus as set forth in Claim 15, including areas on said screen sensitive to touch to. 
cause predetermined functions to be performed. 
60 22. Apparatus as set forth in Claim 15, wherein said screen is substantially flat and adapted 60 
to be used in a substantially horizontal position. 

23. Apparatus as set forth in Claim 15, including Softkeys. on said screen and means to 
execute operatiorial commands in response to touching any of said Softkeys. 

24. A microprocessor-based process for recognition, translation and display of Handwritten 

65 Symbols and execution of commands comprising the steps of: 65 
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(a) Creating a personalized database for each individual user of the process by having the 
user initially input a Handwritten Symbol for each character corresponding with a font to be 
displayed or command to be executed; j - • 

(b) Determining a unique set of characteristics to characterize each such symbol and storing rt 

5 in the database; 

(c) Writing or drawing Handwritten Synnbols on a computer screen with a stylus; 

(d) Digitizing each Handwritten Symbol to Identify the x,y coordinates of a multiplicrty of 

Points defining the Symbol; ^ ^ , ^ • *.u 

(e) Processing the digitized characteristics of each Handwntten Symbol to determine the 
. 10 predetermined characteristics of the Symbol; 

(f) Search the database to find a "hit," a perfect or the closest correspondence to the 

chajactenstic^^^^ the Font Symbol or performing the command most closely associated with the 

"hit" characteristics. ik 
15 25. A process as set forth in Claim 24, including the additional steps of: lO 

(a) Determining if the Font Symbol displayed or command performed is an error; and 

(b) If there is an error, re-Inputting a H.andwritten Symbol for the desired Font Symbol or 
command to modify the database. ' 

26 A process aS set forth In Claim 24, including the additional step of: 

20 (a) Substantially contemporaneously displaying the Handwritten Symbol on the screen as it is 20 

being written or drawn. ..... ^ , . x 

27 A process as set forth in Claim 24, wherein steps (b) and (c) Involve a detemnlnation of 
the (i) iength, (ii) average slope, (iii) centroid height above base line, (iv) curvature, (rate of change 
in slope) and (v) comparison of the location of the centroid of each Stroke with the centroid of 

25 the Handwritten Symbol. 

28. A process as set forth in Claim 27, wherein step (f) comprises: 

(a) Determining the value of each of the five characteristics; 

(b) Subtracting the database value of the characteristic from the newly-measured value; 

(c) Scaling the absolute values of each measurement to make each of the five measurements 
30 reasonably equivalent to the others; 

(d) Adding all five values; 

(e) If a predetermined threshold is exceeded, discarding the comparison and creating an en-or 

"message; and . . t 

(f) Searching the database to find a numerical "hit", or, if not feasible, the closest numerical 
35 iTiatcli between the database value and the newly inputted value. 

29. A process, as set forth in Claim 24, wherein the error rate is 5% or less. 

30. A process as set forth In Claim 28, wherein the program for step (f) requires less than 

6K of machine memory. . , . , . n-j- • 

31. A process as set forth in Claim 24, wherein said Handwritten Symbols include Editing 

40 Symbols and said process includes recognition of the Editing Symbols drawn on the screen and 40 
executing the Editing Functions represented. 

32. A process as set forth in Claim 24, in which text in Font Symbol format Is displayed on 
the screen, and including the steps of: 

(a) Creating a window on the screen proximate to, but not overiying, an area of said text to 
45 be edited; 

(b) Inputting and displaying said Handwritten Symbols in said window; 
(c> Displaying the Font Symbols corresponding to said Handwritten Symbols in close proxim- 
ity to said Handwritten Symbols. 

33. A process as set forth in claim 24, including the steps of: 
50 (a) Creating one or more Softkeys on said screen to cause the computer to perform opera- 
tional functions; and 

(b) Touching one or more of said Softkeys to execute the corresponding functions. 

34. A process as set forth in Claim 24, including the steps of detennining the x,y coordi- 
nates of from about 4 to 8 Points per mm and from about 100 to 200 points per second in 

55 characterizing said Handwritten Symbols. 
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